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Purpose: We aimed to assess the agreement between clinical assessment of diabetic retinopathy 
and Optomap ultrawide-field imaging (UWFI) in a real-life clinic setting. 
Methods: Structured examination findings, from diabetic patients attending routine medical 
retina clinics in July 2011, were retrospectively compared with the grade obtained from Optomap 
UWFI images, graded independently by two ophthalmologists, taken at the same visit. 
Results: A total of 84 eyes (42 patients) were examined, and 74 eyes (37 patients) were suitable 
for analysis. The hospital Eye Service slit-lamp biomicroscopy grades for retinopathy were: no 
diabetic retinopathy in zero eyes; background retinopathy in 2 1 eyes; preproliferative retinopathy 
in 34 eyes; and proliferative retinopathy in 19 eyes. For retinopathy, the agreement between the 
Optomap UWFI and clinical grading was moderate for both graders (K=0.57 and K=0.63), and 
there was almost perfect agreement between the two graders (k=0.92). The clinical grades for 
the presence of photocoagulation scars were: no photocoagulation scars in 46 eyes and pho- 
tocoagulation scars visible in 28 eyes, indicating substantial agreement between the Optomap 
UWFI and clinical grading for both graders (k=0.73 and K=0.64). There were two instances 
where proliferative retinopathy was documented clinically but graded as preproliferative by both 
graders of Optomap UWFI. These were investigated, and neither patient required treatment, ie, 
the difference in retinopathy grade would not have affected the patient outcomes. 
Conclusion: This study demonstrated moderate agreement between Optomap UWFI and 
hospital slit-lamp biomicroscopy grading of patients' retinopathy in a real-life medical retina 
clinic setting. The authors believe that Optomap UWFI is, not only a very useful adjunct to 
clinical examination in terms of detection and recording of retinopathy, but also, could have a 
role in standalone "virtual" clinics. 
Keywords: photography 

Introduction 

The Medical Retina service at Oxford Eye Hospital uses the Optos Optomap Panoramic 
200Tx™ (Optos PLC, Dunfermline, UK) digital ultrawide-field imaging (UWFI) system 
to document objectively the stage of diabetic retinopathy and response to treatment. There 
are a number of examples in the literature showing that under study conditions, Optomap 
UWFI is comparable with more conventional retinal imaging techniques'^ as well as 
mydriatic slit-lamp biomicroscopy, in the assessment of diabetic retinopathy. 

Optomap UWFI angiography has been shown to improve the detection and clas- 
sification of diabetic retinopathy.^ However, we believe this is the first paper assessing 
the utility of Optomap UWFI color images in diabetic retinopathy grading alongside 
a "real-life" clinic situation. 
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We report a comparison of National Screening Committee 
(NSC) grading'' using Optomap UWFI with the clinical grading 
obtained in a routine medical retina clinic staffed by ophthal- 
mologists with various levels of expertise. There is a need for 
the development of alternative strategies for the assessment 
of diabetic retinopathy within UK hospital eye services, due 
to the ever-increasing demands on capacity.' 

Materials and methods 

In a standard medical retina clinic, doctors with various lev- 
els of expertise, using mydriatic slit-lamp binocular indirect 
ophthalmoscopy, examined 84 eyes of 42 diabetic patients. 
Clinical findings were recorded using the Diabetic Retinopa- 
thy Assessment template within the Medisoft Ophthalmology 
electronic medical record (EMR) software (Medisoft Limited, 
Leeds, UK), which requires clinicians to make a structured 
assessment of the clinical signs of diabetic retinopathy and 
outputs retinopathy grades according to the Early Treatment 
Diabetic Retinopathy Study (ETDRS),** the English NSC," 
and intemationaP classifications. The NSC gradings were 
retrieved retrospectively, and the doctors assessing patients 
in clinic were unaware of the current study. 

Optomap digital UWFI, obtained with the patients' eyes 
in the primary position, were acquired at the same visit. The 
instrument is able to obtain wide-field images of approxi- 
mately 1 80-200 degrees, and the optical resolution with the 
instrument used in this study was 1,984x1,984. In keeping 
with the scanning laser ophthalmoscope principle, images of 
high contrast and sharpness are obtained, which show less 
susceptibility to media opacities than conventional photog- 
raphy.^ The two graders viewed the images independently 
and were blinded to further clinical information. The graders' 
findings were compared with the clinical retinopathy grade 
for each eye, as recorded on Medisoft EMR software dur- 
ing two consecutive medical retina clinics that took place 
in July 2011. 

Statistical analysis was performed using PASW Statistics 
for Windows, Version 18.0 statistical software (IBM Corp, 
Armonk, NY, USA). Agreement between hospital biomi- 
croscopy grading and the grading of Optomap UWFI was 
assessed using Cohen' s weighted kappa coefficient (k). The 
K coefficient looks at agreement or reliability in categorical 
variables and is often judged as providing agreement that is: 
poor when K<0.00; slight when 0.00<K<0.20; fair when 
0.21<K<0.40; moderate when 0.41<k<0.60; substantial 
when 0.61<K<0.80; and almost perfect when k>0.80. 

Ethical approval was granted to allow the authors to 
review patients' notes and imaging for the purposes of 



research. We certify that all applicable institutional and gov- 
ernmental regulations concerning the ethical use of human 
volunteers were followed during this research. 

Results 

This study included 42 patients with diabetes mellitus. The 
mean age of the patients was 60 years (range 27-84 years). 
Statistical analysis was possible for 37 of the 42 patients 
(88% [74/84] eyes) included in the study. Images were not 
gradable for three patients (7%), and two patients (5%) had 
incomplete Medisoft diabetic retinopathy grading. A total of 
23 of the patients were examined by a consultant (VC), while 
the remaining 14 patients were examined by nonconsultant 
doctors, including middle-grade doctors and trainees. 

For diabetic retinopathy, the clinical biomicroscopy 
grades were: no diabetic retinopathy (RO) in zero eyes; 
background retinopathy (Rl) in 21 (28%) eyes; preprolif- 
erative retinopathy (R2) in 34 (46%) eyes; and proliferative 
retinopathy (R3) in 19 (26%) eyes. Grading by grader 1 
(RMJP) was in agreement with the clinic grading in 50 eyes 
(68%), showed a lower grade in eleven (15%) eyes, and a 
higher grade in 13 (18%) eyes (Table 1). Grading by grader 2 
(SI) was in agreement with the clinic grading in 54 (74%) 
eyes, showed a lower grade in eight eyes (1 1%), and higher 
grade in 12 eyes (16%) (Table 2). Agreement between 
grader and clinic, using weighted k, was moderate for both 
grader 1 (k=0.57, 95% confidence interval [CI] 0.43-0.72) 
and grader 2 (SI) (k=0.63, 95% CI 0.49-0.78). There was 
almost perfect agreement between the two graders (k=0.92, 
95% CI 0.85-0.99) (Table 3). 

With regard to the presence or absence of photocoagula- 
tion scars, the clinical biomicroscopy grades were: no photo- 
coagulation scars (PO) in 46 eyes and photocoagulation scars 
visible (PI) in 28 eyes. Optomap UWFI grading by grader 1 
was in agreement with the clinical grading in 65 (88%) eyes, 



Table I Cross-tabulation of retinopathy/photocoagulation, 
comparing clinical grading with Optomap ultrawide-field grading 
by grader 1 







Clinical grading 








RO 


Rl 


R2 


R3 


PO 


PI 


Grader 1 


RO 


0 


1 


0 


0 






(RMJP) 


Rl 


0 


7 


8 


0 








R2 


0 


13 


26 


2 








R3 


0 


0 


0 


17 








PO 










cr44 


7 




PI 












21 



Notes: RO^ no diabetic retinopathy, R I - background retinopathy, R2- pre proliferative 
retinopathy, R3— proliferative retinopathy, PO- no photocoagulation scars, PI — 
photocoagulation scars visible. 

Abbreviations: P, photocoagulation; R, retinopathy. 
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Table 2 Cross-tabulation of retinopathy/photocoagulation, 
comparing clinical grading with Optomap ultrawide-field grading 
by grader 2 

Clinical grading 



RO Rl R2 R3 PO PI 



Grader 2 


RO 


0 


0 


0 


0 I^xO^^'''^ 


(SI) 


Rl 


0 


9 


6 


0 !^^><C!^>\ 




R2 


0 


12 


28 


2 




R3 


0 


0 


0 


17 J><C><C 




PO 








<fp><r43 9 




PI 








19 


Notes: R0= 


no 


diabetic 


retinopathy, 


Rl = 


bacl<ground retinopathy, R2- 



preproliferative retinopathy, R3- proliferative retinopathy, PO- no photocoagulation 
scars, PI - photocoagulation scars visible. 
Abbreviations: P, photocoagulation; R, retinopathy. 

showed a lower grade in seven (9%) eyes, and a higher grade 
in two (3%) eyes (Table 1). Grading by grader 2 was in 
agreement with the clinic grading in 62 (84%) eyes, showed 
a lower grade in nine ( 1 2%) eyes, and a higher grade in three 
(4%) eyes (Table 2). Agreement between grader and clinic 
was substantial for both grader 1 (k=0.73, 95% CI 0.57-0.89) 
and grader 2 (k=0.64, 95% CI 0.46-0.82) (Table I). As was 
the case for retinopathy grading, there was almost perfect 
agreement between the two graders (k=0.90, 95% CI 0.80-1 ) 
with respect to the grading of photocoagulation (Table 3). 

Discussion 

We compared two people reading Optomap images with a 
real-life clinic situation involving doctors with varying levels 
of expertise - the clinical team did not know that this was 
happening. Other published studies have compared Optomap 
images with slit-lamp biomicroscopy by a consultant in a clini- 
cal trial setting, which is far from the reality of a busy medical 
retina clinic. ^-^ Results showed moderate agreement between 
Optomap UWFI and hospital Eye Service biomicroscopy 
grading with regard to retinopathy (RO- R3) and substantial 
agreement with regard to photocoagulation (PO or PI). 

Table 3 Cross-tabulation of the level of retinopathy/photocoagulation, 
comparing the graders of the Optomap ultrawlde-field images 



Grader 2 (SI) 







RO 


Rl 


R2 


R3 


PO 


PI 


Grader 1 


RO 


0 


1 


0 


0 






(RMJP) 


Rl 


0 


13 


2 


0 








R2 


0 


1 


40 


0 








R3 


0 


0 


0 


17 








PO 












1 




PI 










\^ 


21 



Notes: RO^ no diabetic retinopathy, R I — background retinopathy, R2- preproliferative 
retinopathy, R3— proliferative retinopathy, PO- no photocoagulation scars, Pl- 
photocoagulation scars visible. 

Abbreviations: P, photocoagulation; R, retinopathy. 



Of the 19 eyes that were graded clinically as R3, 17(89%)) 
of these 19 eyes were graded as R3 by the graders and two 
(1 1%) were graded as R2. Clearly, it is important to look at 
these discrepancies as any "missed" proliferative retinopathy 
could lead to harm for the patients concerned, so the clinical 
notes and Medisoft records were reviewed for all R3 patients. 
Of the two eyes that were graded R3 on Medisoft but as R2 
by the Optomap graders, one was documented as "new ves- 
sels elsewhere (NVE) with surrounding old-looking retinal 
hemorrhage - not active"; and the other had "vitreous 
hemorrhage" written in the notes, but no new vessels were 
documented on the retinal drawing. Both patients had had 
previous panretinal photocoagulation, and neither patient 
required further laser or surgery as a result of the clinic visit in 
question, ie, the difference in grading would not have altered 
the patients' management on these occasions; nevertheless, 
there was the potential for incidents that could have signifi- 
cant impact on patient care. In a study by Sallam et al," that 
compared the level of agreement between grading of digital 
photographs in a diabetic retinopathy screening service and 
hospital biomicroscopy grading using the same NSC clas- 
sification, R3 was only recorded by screeners in two of the 
nine cases that were picked up on clinical examination - it has 
been hypothesized that the wider field of view in Optomap 
images (180-200 degrees) could increase the sensitivity to 
peripheral new vessels compared with two-field screening 
photographs (two 45-degree fields).'-'^ 

The grading of retinopathy from the Optomap images 
was very consistent between the two graders, with the k for 
retinopathy grading (R0-R3) and for presence of photoco- 
agulation scars (grading PO or P 1 ) suggesting almost perfect 
agreement. 

When comparing the clinical grading to that made from 
Optomap UWFIs by the two graders, there was substantial 
agreement with regard to photocoagulation (PO or PI). This 
is important as the presence or absence of panretinal pho- 
tocoagulation could affect how a patient with retinopathy 
graded as R2 or R3 is managed. 

However, for retinopathy, the agreement was not so 
strong. In practical terms, it is important to consider how 
the retinopathy grading affects the management of patients; 
for example, patients graded RO or Rl may be discharged 
to annual screening in the community, whereas an R2 grad- 
ing is likely to lead to closer follow up (ie, 6-monthly as 
opposed to annual review), and a grading of R3 could result 
in the patient being offered laser treatment. In addition, the 
graders of the Optomap images adopted a similar approach 
to screening, with a goal of producing the most accurate 
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retinopathy grade, whereas the approach in chnic tends to 
be much more practical, and focused on patient outcomes, 
ie, the need to treat. There were no examples of a two-step 
discrepancy between the clinical grading and Optomap retin- 
opathy grading (ie, RO vs R2 or Rl vs R3), which means that 
a vastly different patient outcome from the two modalities 
would have been unlikely. The two "missed" R3 patients have 
already been discussed - neither patient required more laser 
treatment, so the outcome would have been unaffected by the 
different grading - but instances where a patient is graded 
as R2 instead of Rl, or vice versa, could affect the patient's 
management, particularly in terms of the follow-up interval. 
Examining the discrepancies between the Rl and R2 gradings 
revealed that grader 1 was in agreement with the clinical grad- 
ing of R2 for 26 eyes, gave a more severe grading (ie, R2 vs 
Rl) for 13 eyes, and a less severe grading (ie, Rl vs R2) for 
eight eyes. In the case of grader 2, there was agreement with 
regard to R2 for 28 eyes, the grader recorded a more severe 
Optomap grading (ie, R2 vs Rl) for 12 eyes, and a less severe 
Optomap grading (ie, Rl vs R2) for six eyes. This suggests a 
tendency for the imaging grading to be more severe than the 
clinical grading, which was also demonstrated in a similar 
study comparing diabetic eye-screening service images at 
referral with the subsequent clinical grading." A weakness 
of the current study is the lack of opportunity for arbitration, 
ie, the ability to reassess patients where there was disagree- 
ment between the clinical and Optomap grading, to establish 
whether there had been under- or overgrading, and by which 
modality, in each case. Furthermore, the clinical grading of 
diabetic retinopathy was performed by ophthalmologists 
with varying levels of experience in the medical retina clinic, 
whereas the Optomap image grading was performed by two 
experienced ophthalmologists, which could have induced 
misclassification bias. 

In conclusion, this study demonstrated moderate agree- 
ment between Optomap UWFI and hospital slit-lamp bio- 
microscopy grading of patients' retinopathy in a real-life 
medical retina clinic setting, by doctors of varying levels of 
expertise. The detection of proliferative retinopathy using 
UWFI compared favorably with other studies,^ and there were 
no obvious instances where discrepancies between UWFI 
and clinical grading would have significantly or adversely 
affected patient outcomes. The authors believe that Optomap 
UWFI is, not only a very useful adjunct to clinical examina- 
tion in terms of detection and recording of retinopathy, but 



also, could have a role in standalone "virtual" clinics, where 
retinopathy is assessed using UWFI and maculopathy by 
ocular coherence tomography. However, further investigation 
with a larger study size is required before we can recommend 
the replacement of clinical examination with Optomap, and 
ocular coherence tomography-based virtual clinics as the 
standard of care. 
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